0F< 




UNITED STATEsApARTMENT OF COMMERCE 
Patent and Trademark Office 

Address: COMMISSIONER OF PATENTS AND TRADEMARKS 

Washington, D.C. 20231 ^ ^ 

S • J 



APPLICATION NO. 


FILING DATE 


FIRST NAMED INVENTOR 


ATTORNEY DOCKET NO. 


09/032. 65 


y 02/27/98 


ANDERSON 


E 





r 



LN02/0503 



EXAMINER 



STEF'HEN G SULLIVAN 

152 N THIRD STREET #30 0 

SAN JOSE CA 95112 



ROSSI . J 



ART UNIT 



PAPER NUMBER 



_.__3/'72 
DATE MAILED: 



05/03/99 



Please find below and/or attached an Office communication concerning this application or 
proceeding. 

Commissioner of Patents and TVademarks 



PTO-90C (Rev. 2/95) 



1- File Copy 





Office Action Summary 


Application No. 
09/032,659 


Applicant!) 


Anderson 




Examiner 

Jeffrey Allen Rossi 


Group Art Unit 
2772 





Kl Responsive to communication(s) filed on Feb 27, 1998 . 

□ This action is FINAL. 

□ Since this application is in condition for allowance except for fornnal matters, prosecution as to the merits is closed 
in accordance with the practice under Ex parte Quayle, 1935 CD. 11; 453 O.G. 213. 

A shortened statutory period for response to this action is set to expire 3 nnonth(s), or thirty days, whichever 
is longer, from the mailing date of this communication. Failure to respond within the period for response will cause the 
application to become abandoned. (35 U.S.C. § 133). Extensions of time may be obtained under the provisions of 
37 CFR 1.136(a). 

Disposition of Claims 

Kl Claim(s) 1-13 ta^re pending in the application. 

Of the above, claim(s) NONE ts/are withdrawn from consideration. 

□ Claim(s) is/are allowed. 

Kl Claim(s) 1-13 46/are rejected. 

□ Claim (s) is/are objected to. 

□ Claims are subject to restriction or election requirement. 

Application Papers 

Kl See the attached Notice of Draftsperson's Patent Drawing Review, PTO-948. 
K! The drawing(s) filed on Feb 27, 1998 is/are objected to by the Examiner. 

□ The proposed drawing correction, filed on is Qpproved QJisapproved. 

□ The specification is objected to by the Examiner. 

□ The oath or declaration is objected to by the Examiner. 

Priority under 35 U.S.C. § 119 

□ Acknowledgement is made of a claim for foreign priority under 35 U.S.C. § 119(a)-{d). 

□ All □ Some* DNone of the CERTIFIED copies of the priority documents have been 

□ received. 

□ received in Application No. (Series Code/Serial Number) , 

□ received in this national stage application from the International Bureau (PCT Rule 17.2(a)). 

•Certified copies not received; 

□ Acknowledgement is made of a claim for domestic priority under 35 U.S.C. § 119(e). 

Attachment{s) 
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□ Interview Summary, PTO-413 

Kl Notice of Draftsperson's Patent Drawing Review, PTO-948 

□ Notice of Informal Patent Application, PTO-1 52 
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DETAILED ACTION 

1. This Office J\etipni|sli^^ to the fbUowing cbrimiJiniiation^ the 
application, ffled 02/27/98. 

2. eikims 1-13 are pending in the application. Claims 1, 7, and 1 1 are 
independent. All claims are as originally filed; ; 

3. It is likely that the group Art yik has; (Manged since Me last communication. 
T|ie new Art Unit is 2772. To insure the proper and expedient correlation of papers 
with the Application, all correspondence; should be directed to group Art Unit 2772 (eff. 



Drawings 

4. The difawings are objected to because legends are not present in Figures 4-5, 
7A-B, 8A-C, and 9A-B. Pursuant to 37 CFR 1.84-^, Examiner-requires legends or 
labels for all numbered elements, with careful attention to be made with respect to the 
addition of new matter. Correctioniis required. 
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Claim Rejections - 35 USC § 103 

5. The fbllovdrig i^^;^q^^ of 35 U.S.C. 103(a) whiGk/fpims>the basis for all 
obviousness%eT<efetions set fortteiin this Office action* ^ 

(a)l^'<gatent may not be obtained^&pwjgii^t^ identically discloseS|pr described as set 

^for^ in section 102 of this tide, i$tiie;^diffe^^^ subject matter sou^t;to be\patented 

and^the prior art are such that the^subjlct ma^^^ would have been obvious at the time the 

^ : ^^nvention was made to a person having^Grdinaj^|s^^ the art to which said subject matter/pertains. 
-^Patentability shall not be negatived by|the mannerciii which the invention was made. 

6. Claims 1-13 ar^rqected under^S UvSt©. t03(a)-as being unpatentable over 
Parulski . European patent no 661,^58^iOj7 in viev^ of Qgawa . U.S. Patentyno. 
5,^98,851,03/1993.. ; : „ 

7. Per independent daiin;4-r- ga^^^ for controlling user 
interaQ;ion in a digital imaging;de\dGe,.^ device having a display the 
meth0#6omprising the steps'^cijK^^^^ ^ 

a) r providing the digital imaging device vdth a directed image capture 
sequencei^omprising a set d^elec^ro^ic-instruG$ions J'the plan may bie.. . recorded in 
electronic form on an instruction disk'— col. 3, lines 21-30); 

b) executingHh^e^directed image capture sequence to display instructions on 
the display that prompt the user tpfpefforirirspecific^opferations (accessed through 
processor 12 — 3: 21-29; and 

c) guiding the user through a series of related image captures ("instructions 
direct an operator, for example, to take four different poses" — col. 3, Ins. 25-29). 
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Parulski lacks an explicit recitation of "interactive instructions". Ogawa, on the 
other hand, demonstrates thaffe^^^ notoriously!^ well7kno^^ to provide interactive 
instructions, i.e., a ^npt,^ ("interactive cSmm^nicati with the camera, 

and the settingiJof the data pack"— 1: 57-61, for taking pictures"Mgsv2-7. It would 
have been^Mbus to one of ordirikig^skill in the^arfcat the time of the invention to 
combirf^fi[gawa with Parulski . bymSMngiP^r^^ interactive in 

processor 12 of Parulski . because interactive fiiistructions would have been easier to 
follow; 

Regarding the use of the clainii^nguage "related image captures", the Examiner 
4iad.contemplated that ifiQgavi%£d6ne Jvoil^ thepfeature "related image 

captures", since a user q!f OgaMa^wpi^^ employed O gawa to capture 

ims^es that were related;^ /Howpj^ of this claim, it loepame 

appaient that the Applicant-expliii^l^^ captures" in conjunction 

witW^'^tructions" vvhicji^i^guiif s^h^ jthe instiructio^-somehow expressly i^te to 
the captur^pf multiple ima^ges in order tp^reempt this clmm. 

Regarding^the use of the 4;^fmihdlogy "iscript" it is believed that the interactive 
instructions theinselyes constitute a script; Even if Applicant disagrees with this 
premise, the instructiPhs/are eyidenpe of an underlying iS because scripts were a 
notoriously well-knovm low level prbgrammingdanguiage to effect these types of 
operations. 

2 Regarding dependent claim 2, Parulski and Ogawa demonstrate all elements as 
applied in the rejection of claim 1, supra. Per the limitation of "wherein step a) further 



Application/ Control Number: 09/032,659 (ANDERSON) 
Art Unit: 2772 



Page 5 



includes the step of providing the directed image capture sequence by externally 
loading the program instrupJ:i(toSi4nt© the digitMnmagm this is suggested by 

Parulski (disk driy(e<i3Vrf^ 1; "instruction disk"— 3: '^2^25). 

3 Regarding dependent claim 3, Parulski and O gawa demdnstratfe all elements as 
applied ip|lk:rqection of clain^||u^ Per th^%iitation of "wherein^step a) further 
includeslthe step of providing the prqi^&^^ as a text-based script^', this 
sugg^ed by the observation that the Parulski's instructions are human readable. 
Howe^^fer, it is also noted that text based scnptjprqgramming languages, such as 
Java™, were notoriously well-known in i the/art. It would have been obvious to one of 
oi^dinary skill in the art at the time,d£^the in^eritiM to employ a text based script-in 
Parulski and O gawa . because text based/ scnpts^a^^ programmed by a novice, 
easy^ito understand, andfi^e^par^^ independence. 

4 J^egarding dependeritxlain]^ demonstrate all elements as 
appUedtiri^the rejection of iclaim^f supro^ t6e^"toiita^ of "further includes the 
Step of ^^QMing the directed image captui|e sequence By interpreting the^xt-based 
script", it was4nSjtpriously well-lMpwh to interpret .text based scripts <t^,perform 
program instructions. Interpretation would have been obligatory in the above 
combination because dig^al i?rq;cessqrsjio n^ "understand" text: they employ binary 
numbers. 

8. Regarding dependent claim 5, Parulski and O gawa demonstrate all elements as 
applied in the rejection of dependent claim 4, supra. Per the limitation of "wherein step 
c) further includes the step of prompting the user for specific information, and entering 
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the specific information on a text entry screen", this feature is a well-known facet of 
interactive displays (interactive,^^ m spine user input is required). Since this 

is a necessary parj, (iMiSfe of Parulski and ^gawd r the method and 

motivation tpiBombine are identical to that set forth in, claim 1. 

6 /Regarding dependent clairiS^v Parulski ahd^§i> gawa demonstrate alf efements as 
applied to the rejection of dependent claim S*s^ik?ra. "Official notice is hereBv tdken 
thati:ranslucent overlay bars were nqtopc^sly,^ in th art of graphical user 



interfaces. It would liTave been obviou^to o^e of ordinary skill in the art to provide a 
4r^slucent overlay on tlae display screen ik^b^ Pamlski . in order to conserve spacgi 
and thus reduce the sizq of tKi^s^^tem of Parulski. 

7 . > Per independent claim ;7r,-.Ogawa discl^ a method for directing image capture 

sequences in a imaging device h^Wng a; d comprising the steps of: 

'1,.. '"^^^^'^ ' ■ ■ ' ' ■ " " " " ^ -^^ '"^^ " " " ■ ■ ■ 

. a) externally Ipading^^cript comprising^pjrbgram commands intoiithe digital 

imagmg device (see ic card 3f Fig. 1 A); I r^^v 

b) . displaying the script as a menu item for selection by a user (Fig. 2, e.g., 
"user custorqization"— 3: 65); ,,, y J-,., ' ■ f.; ■ 

c) in response to the user selecting the script menu item^Jrom the menu, 
passing operational^control from the digital imaging deyit:^ to a script interpreter 
(implicit, when the use is interacting with the script , the user is not interacting with 
the camera.; 

d) interpreting and executing each of the script commands, wherein a first plurality 
of the script commands are for displa5dng interactive instructions on the display 
requesting the user to perform specific camera operations, thereby guiding the user 
through a series of image captures (Figs. 2-9c, especially 9c); 



4 
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e) passing operational control from the script interpreter to the digital 
imaging device after the script has^equeste%the:fuser to capture an image ("...ic card 
which stores the informatibn^ pir^h^ ^amera4nd traiisniit|Ae information to the 
camera when reqmred to set the operation of the camera-^1: 41-43); and 

While 4t |s arguable whether Parulski de facto passes operational-^control from 
the came^J:6M^ie script interpriete^,,this is suggested&y Parulski . i^e,^it would be 
countemhfuitive to operate the %rnera^^^^^ were being made^to^ critical 

settiilgs ("...ic card which stores th^iMormation^btf the camera and transmits the 
information to the camera when reqiiired touset^the operation of the camerar^ l: 41- 
43)t. 1^ it would have been obviouslV one of ordinary skill in the ai^ ^t the 

time of the invention J:q j3^ script interpreter in 

order to prevent pictures from being it'aken;^hile^Ogawa's critical parameters were 
^mg changed. p _ -S, ■ ,, ' , 

Although O gawa suggested "related images^Fig. 9c), it's instructions are not 
directed toward multiple images;per se. Parulski . on the other hand, explicitly 
d^onstrates electronic [mli^a^^ It would have, been 

ob^(^ ton one of ordinary slffl[Qnrtl^^ invention to conibine 

Panjfeilyyith Ogawa , byijempacpkCg^cri i.e., sets of instructions, 

for takinglmultiple relatd^i gictures, in orddr for example, tib enable a user to take 
appropriajejpfo^ for a:^^)ersonalized yideo game, as taught by Parulski— Abstract, 
and thus expafid^vthe applicatiofts^^lOgam.JkRegafding the limitati6h<pf "digital" 
imaging devicerthe t^gnefits of digital £8ehn6l!ogies are notorious;^ wfelliknown, such as 
portable picture formats, eiSse o^ by numeric DSP techniques, ease of 

programmability, and "in^tant"^corapati^ cpn:^iiter hardware. 

The Examiner remarks that the explicit recitation of "passing control from a 
digital imaging device to a script interpreter" implies theat the "script interpreter" is not 
part of the "digital imaging device". This is a question of semantics, since it depends on 
what on intends to include in the term "imaging device". The rationale behind the 
rejection, however, is largely unaffected by this observation, since it would have been 
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obvious to one of ordinary skill in the art at the time of the invention to allow a user to 
take a picture by "passing control" dioi the Raging-device, in order to allow a user to 
effect the operations (s^ej^s\iii^^ a well-known tenant of 

modular programmiiig^ i^e, passing control from one modUle^tb^another in order to 
allow modules^to be>changed without changing entire sets of progranis. 

8 Pei^4^pendent claim 8, Parulski and Ogawa^demonstrate all clfitimed.elements as 
appliedjin^the rejection of indepej^|^1%laim 7^ sti0a. Per the limitation pf:'%herein 
step ajjukher includes-thiTsfep o^imlk^die^into^he digital imagine device from a 
remq^^lememory'', this is suggested J^thi^v ^ (disk 13, Fig. 1), and^ Qg^wa : ic 
3^gj|l A. This limitation provided thf 'np|onc)Usly well-known benefit of changing 
program instructions,, f::^" 

9 Per dependent c^pl 9, Parulsjgij a^ demonsitfate all claimed elements as 
..allied in the rejection (|f indep^end&t^s^^ Peri the limitation of 

"operational control from th^^^^t^^ffiSgin^^ the script after the user has 

captured the image" a similar £a:g\i^nieri^^^^^ "passing of operational control" 

in^riclependent claim 7, supra. It wquJj^ to one of ordinary skill in 

th^^aj^t the time of th^j ihvStTLtig(nrto||as ifhe script after capturing an 

imagMn^prder to allow for cofiSintied instructions^ images are claimed.. 

9 P^dependent cl^m 10^ Parulski ^and Ogawa demonstrates all claimed elements 
as applie^iNthe rejection^of independent s 9, supra: Per the limitation of "wherein 
step f) further^iribludes the step'xClpsging^era^ control badk: tGpthe digital 
imaging device*£ifter the script completes^^execution", it would hav^^^ri obvious to one 
of ordinary skill in the)art at>the time of the invention to>db this\jh order to allow a user 
to continue using the im^e^^pce^ySoij^ assist^ce of interactive help, in order 

to allow the user to do other things!. 
9. Per independent claim 11, Parulski demonstrates 

an imaging device 20 (Fig. l)for capturing image data ; 

a memory coupled to the imaging device for storing the image data as captured 
images 12 (Fig. 1); 
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a display for displaying a captured image 14 (implicit, a well-known feature of 
digital imaging devices as showninrf^ig. 1); 

means for external§^lp^E^ mscripfa^hstructibn Idoo^ electronic form— 3: 
20-25) comprisinglpiio^g^ into the memory (; r 

a proc^1sspr^i2 coupled fo the imaging device and to the rnfemofy^for controlling 
operation|0f4He digital imaging^icieyice, 

JR^ruiski lacks an explicit re<:i|aftipn^ 'H^ie processor including means for 
interpreting and executing each of the script commands, wherein when the script 
comriiands are executed, interactive^iiistructiioiis are displayed on the disMay 
requf Mting the user to perform specific/csuoief^^^ thereby guiding the user 

through a series of relale^unage^ck^ instructions was 

notoriously well-knowii^and additionall|r demonstrated by Qgawa Figs. 2-9c. It would 
ha^e been obvious to one of ordma^-slall in^l^^^ at theltime of the invention to 
conibine Q gawa with Pariulsiaj Dy p^ instructions on display 12 of 

Parulski . Scripts are an|imglici|^|^itic^^^ and thus a script 

^A^iiiaf have been the prefeixed^ and Parulski . The.ratibnal 

for corpDining Qgawa and Pafm^te has^eefeela^ further detail in the rejection 

of claim 1, and therefore has been summarized here iii^ordte^ to avoid repetition. 

10. Pe^i|ependent claim^ia, a script mterpreter is'^a^necessary component of 
employing js;cripts, and is siaggested by Qgawa (see scri]^, Figs. l-9c), as was 
notoriously well-known in the ^tSof interactive helf0;^ 

11. Per depencient.^;laim 13, the limitatMi of "a control prog|am\si^^ in memory 
and executed by th^irpcesso^ control program comprising,: " 

means for displaying jSiel^n a menu i|em on the display for 
selection by a user" is suggested by Q gawa (eVg.. Figs l-9c, ""user customization"— Fig. 
3) as was notoriously well-known in the art of interactive menus.; 

Per the limitation of "means for passing operational control to the script 
interpreter in response to the user selecting the script menu item from the menu", it 
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would have been obvious to one of ordinary skill in the art at the time of the invention 
to do this in order to initiate a scriptffendiffiaeraetiwith it. 

More detail regaidi^ggtlSe^J^ aiad motivation fbr^^ regarding these 

limitations has b^eriis^fetprfE, supra in this action. < 
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Prior-Art Made of Record Establishing State-of-the-Art 
Pertinent to Applicant's Disclosure 



12. The prior art made^ctf^e^o^d and not orelifed u^^n is,eonsidered pertinent to 
applicant' s disclosure)^ ft ^ " ' : - /o / 

AppUccmiMs reminded that fin amending in response to a r€jecti6n/gfi<^qd^ in an 
application..,, ItW applicant... must^c^arly point out the patentable rwvelty vMcK^ or she thinks 
the claims^j^eserit in view of the stx0^f^}}e art disclpsM{t>y the references citedofthe objections 
made. H&of%he must also show h<m}li]^^amendme such references oro^eGtrons* (See 

37 cFmmii (c)) ^^5^4^^ ' V!J^rc--:^0 

>. Patgrits 



5,477,264 


Sarbadhikari»=(seer:elemeri:t-24BpE%^^^ 14tnrn1 rK In 91 


5189490 


Shettv 


(see esp. 5:ig^.5K : 


=5fe386 


Barber 


(se^|p^qn^%ln^ ) 


5220614 


Grain 


'{ke0^^^^^ cc^J'^,ln^^^O, col. 3, Ins. 55-60) 


5797051 


Mclntvre 


,(see-ali^pa|e|;^^ patent) 


5432871 


Novik 


■--(seie^esprAis&ae^ ■ ■ 


558F-U4'0 


Brenan 


Jsee-^sionpLE^ary^ of<ii^^ : 


45ll^» 


Michalik i 


"^see'^aSstract)!! "'"''I/'^C ' 


5764276»)^ 


Martin 


(see esp. Fig. 1) 


5,644,69f 1 


Appleton 


describes scriptis in digital^movies see whole patent 


4916435 


jFuifer 


another applicatifon of scripted digital imaging, see whole 

It 


4540276 


Ost ^'/-C 


/(fefeeiFigs. 51-5d) 


5,343,509 


Dounies 


shoves digitalidevic^, operatmg-according to script see whole 




patent 




5432871 


Novik 


(see esp. col. 2, Ins. 31-42) 


5231651 


Ozaki 


(see abstract) 


5473370 


Moronaga 


(see abstract) 


5589902 


Gruel 


(see whole patent) 
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Foreign Patents 



EP 729,27 1 A2 (see wKole patent) r^ l? 

EP 817,476 A2 ^ (g^rll^aching on viewfinders) ^ 

JP 9-171213, % (see related us patent, date qualifies as priorfajgt)!^ 

EP 568,4^A||> (see US reference by same author) '''^'!''\^^vy^ 

$ Non-paten^t^terature 



GrimnR Leigh "The Manipulation Proclamattiphf see discussion of "Guided Activities. 



,,.v-r^y:;;i, !; ■^■■^™™^-^^>»mA>»t«K^ v..,, ' |i ■ ■Jvi~^|J'" '', v.. _,vfv - -Ift^-r^- ■ i^'i^^ ■ 



'-^fhp search of this^ case fbeuseil on ^prior^art "in the genre" of Applicant's 
disclosed application, i.ei, gen:eral use optical camertsjypical associated with. mobile 
"picture taldhg", and taking in to account||otential limitations that could^eventually be 
mcorporated intpiApplicant's claiinsl Hov/eyer, itas duly noted that t^e use of broad 
claim language such a^ "digital imagingi^evice" and "script" appeafs^fo read on 
multitudinous known digital imaging devices, such as tom^pgraphers, i.e., CAT 
scanners, photocopying machines, micr0sc|p^ lifiho^aphy machines, and X-Ray 
devices, just to name a few. Loadable sMpts^hich provide instructions for multiple 
related images (noting that "related images" is implied in CAT scans, dental X-rays, 
microscopic imaging, and double sided copies, for example) appear to have been 
employed in these devices. Certainly the motivation to employ interactive help type 
scripts in these devices was strong, they would have been difficult or impossible to use 
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without them. Furthermore, it was notoriously well-known to provide these types of 
scripts, which provide interactive he|pi just^ thcnphotocopying digital imaging 
systems, for example. Ali?crfkthes^pit0ductSv4:oo numerous::to,cite, bear on the 
patentability of Applicanis^^^^ 
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Conclusion 

13. Any response to.tJilk:aclBr^^^^ : 
ComMssip Patents and Trademarks 

W^ashington, D.C. 2023 1 
or faxed to 

^}^S (703)-308-9051 (fo^rao^i^ intended for entry) 

I:f%f (703)-305-9724 (inforiitaftconmiSMcations labeled PROPOSED^or 
DRAFT) 'CJS 
Hand-deUvered respo ng es sh^g|iM:^^ 

Sixth Flo5r^Receptionist>f ry^^tal ^su-k II, 212yCrystal Drive, ArUngton, 



14. Any inquiry concerning this conpmunieatiori oLearliter communications from the 
examiner should be directed^o JMfey#OS^^^^ number is (7O3)-308- 

523C|§|?The examiner can hoifflgly^b^jlgail^^ Friday from O830'to' 1630 

If ef^empts to reach the examinerijby telephohe^^sa-e unsuccessful, the examiner's 
supervisosiijpark POWEU&^^an be reached! on (703) 30§,9703. 

ArijHingiiiiw of a generaTftatuije or f elatifJg4o the status of thi^siapplication or 

proceeding should be,4irected to the Group-receptionist whose telej^fepne number is 

(703) 305-3900. :\ " 

/. ......... ..-..vv 




MARK R. POWELL 

SUPERVISORY PATENT EXAMINER 
GROUP 2700 



JR 

April 26, 1999 



